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SUB- VISIBLE CLOUD COVER ASSESSMENT: VNIR-SWIR 

10 Inventors 

Arthur L. Boright 
John C. Sluder 

Related case 

This application constitutes a continuation-in-part of the co-pending, commonly- 
15 owned U.S. Patent Application No. (undetermined) entitled "CLOUD COVER 
ASSESSMENT: VNIR-SWIR," filed under attorney docket number BING-1-1037 on 
November 24, 2003, which is incorporated by reference. 

Field of the Invention 

This invention relates generally to image processing and, more specifically, to 
20 detection of cloud cover in high-altitude and/or orbital overhead imaging data. 

Background of the Invention 

Overhead imaging studies of a surface below may be hampered by the presence of 
cloud formations. Understandably, thick clouds between an observation point and the area of 
interest under observation can conceal objects or features in the area of interest. Potentially 
25 worse in some cases is the presence of thinner cloud formations that do not entirely occlude 
the surface, but may reduce the contrast of surface features and change the derived surface 
spectral reflectance signature with resulting impact on information products such as spectral 
vegetation indices. Presence of thin cloud formations, such as cirrus clouds, can skew the 
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analysis of such surface features by causing researchers to confuse presence of cloud features 
for features or changes in the surface region of study. For example, FIGURE 1A shows a 
representative image 100 of a surface area under study. Merely looking at the image, it may 
be difficult to determine which aspects of the image are surface features 110 and which 
5 aspects are cloud features 120. Further, even though not visible to the naked eye observing 
an image, or to the eye of a person examining such an image, even sub-visible cloud 
formations can significantly degrade quantitative spectral analyses of an area being imaged. 

Because the presence of cloud formations can interfere with the accuracy of overhead 
imaging studies, methodologies have been developed to detect the presence of cloud 

10 formations so that accuracy of surface studies will not be undermined by undetected cloud 
patterns. One approach is to use "clear-sky" spectral or reflectance maps of the areas of 
interest to detect the presence of clouds. By comparing the clear-sky maps with current 
imaging data, large-area spectral or reflectance changes may signal the presence of cloud 
cover. This approach involves successfully collecting, verified clear-sky imaging data of the 

15 area of interest. The clear-sky maps typically are created using thermal infra-red 
measurements to determine the presence of cloud formations. Most cloud formations, 
including high altitude such as cirrus clouds made up of ice crystals present a distinct, 
differentiate thermal signature. If thermal data indicates the presence of cirrus or other 
clouds in an area of study, it will be understood which portions of the image data are affected 

20 by the presence of clouds. Thus, analysis of the area of interest will not be distorted by the 
presence of undetected cloud formations. 

FIGURE IB shows a "cloud mask" 150 derived using conventional techniques to 
show the cloud features 120 in the original image 100 of FIGURE 1A. Absent the cloud 
mask 150, it can be appreciated that it might have been easy to confuse edges of cloud 

25 patterns 120 with surface features 1 10. 

Unfortunately, as is readily appreciated, collection of thermal-infra red data requires 
equipment capable of gathering thermal-infrared data. In the realm of orbital satellites, 
integrating such equipment into the satellite increases cost. Additional telemetry involved in 
making use of such data also is resource-intensive and costly. 
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Even where such clear-sky data are available, continual accurate analytical 
comparison of archival clear-sky data with currently-captured imaging data is needed to 
ensure that the captured data represents suitably accurate, cloud-free images. Determination 
of whether the imaging data is suitably cloud-free is a significant concern. If it is not 
5 accurately determined whether captured images are suitably cloud-free, it may be necessary 
to arrange for the areas of interest to be re-imaged. Analysts who desire to use images from 
an image archive need to be assured that the image data is sufficiently cloud-free to be 
worthy of acquisition and use in their research. In addition, before quantitative analysis tools 
are applied to analyze the imaging data, the imaging data must be determined to be suitably 
10 cloud-free to ensure that the resulting quantitative analyses will be correct. Alternatively, 
algorithms may be applied to correct for thin cirrus cloud effects over portions of images 
affected only (no visible lower cloud) by thin cirrus cloud of reflectance below some 
arbitrary threshold. 

Thus, there is an unmet need in the art for a method for determining presence of 
15 clouds and sub-visible clouds in aerial imaging data not involving use of special thermal 
infrared sensing equipment or the data collected by such equipment. 

Summary of the Invention 

Embodiments of the present invention are useful in determining the presence of sub- 
visible clouds without involving thermal infrared detecting equipment. Embodiments of the 

20 present invention use spectral and spatial tests applied to pixel-level spectral measurements 
to determine the presence of cloud formations. The tests are computationally simple and, 
thus, do not impose an unreasonable operational computing workload. A sequence of such 
tests may be successively applied to the pixel-level spectral measurements to classify the 
pixel as indicating presence or absence of a cloud. Embodiments of the present invention can 

25 be used with various forms of visible cloud assessment to detect presence of sub-visible 
cirrus cloud formations. 

More particularly, embodiments of the present invention provide methods, computer- 
readable media, and systems for determining whether a data point indicates a presence of a 
sub-visible cloud using visible, near-infrared, and short wavelength infrared data. A data 
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point is selected from an imaging study of an area potentially covered by at least one of 
visible clouds and sub-visible clouds. A determination is made of whether the data point 
indicates presence of a sub-visible cloud. The determination is made by first excluding 
presence of visible cloud, and then comparing a cirrus-band reflectance of the data point with 
5 a sub-visible cirrus-band reflectance threshold. The data point is classified as a sub-visible 
cloud point if the cirrus-band reflectance of the data point exceeds the sub-visible cirrus band 
reflectance threshold. 

Embodiments of the present invention can be combined with visible cloud detection 
systems and methods, advantageously preventing otherwise undetected sub-visible clouds 
10 from corrupting data gathered in an imaging study. Embodiments of the present invention 
can be combined with systems and methods for detecting visible clouds using visible, near- 
infrared, and short wavelength infrared data. Embodiments of the present invention also can 
be combined with systems and methods for detecting visible clouds using thermal imaging. 

Brief Description of the Drawings 

15 The preferred and alternative embodiments of the present invention are described in 

detail below with reference to the following drawings. 

FIGURE 1A is a conventional aerial image of an exemplary region of interest in 
accordance with the prior art; 

FIGURE IB is a conventional cloud mask derived from conventional techniques to 
20 indicate the presence of clouds in the image of the exemplary region of interest in accordance 
with the prior art; 

FIGURE 2 is a graph plotting NDSI values versus D values and illustrating points 
where clouds are present; 

FIGURE 3 is a flowchart of a routine according to an embodiment of the present 
25 invention for determining presence of cloud formations; 

FIGURE 4 is a flowchart of a routine according to another embodiment of the present 
invention for determining presence of cloud formations; 

FIGURE 5 is a block diagram of a system according to an embodiment of the present 
invention; 
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FIGURE 6 is a flowchart of a routine for detecting presence of visible clouds and 
detecting sub-visible clouds according to an embodiment of the present invention; 

FIGURE 7 is a flowchart of a routine according to an embodiment of the present 
invention for detecting presence of visible and sub-visible clouds using visible, near-infrared, 
5 and short wavelength infrared data; 

FIGURE 8 is a flowchart of a routine according to another embodiment of the present 
invention; and 

FIGURE 9 is a block diagram of a system according to an embodiment of the present 
invention for detecting sub-visible clouds. 

1 0 Detailed Description of the Invention 

The invention relates generally to image processing and, more specifically, to 
detection of sub-visible cloud cover in high-altitude and/or orbital overhead imaging data. 
Many specific details of certain embodiments of the invention are set forth in the following 
description and in FIGURES 1-9 to provide a thorough understanding of such embodiments. 

15 One skilled in the art, however, will understand that the present invention may have 
additional embodiments, or that the present invention may be practiced without several of the 
details described in the following description. 

Embodiments of the present invention can be used to determine the presence of sub- 
visible clouds in imaging data. Embodiments of the present invention can detect sub-visible 

20 clouds with spectral and spatial tests applied to pixel-level spectral measurements to 
determine the presence of sub-visible clouds without the use of thermal imaging data. Sub- 
visible cloud detection using embodiments of the present invention can be combined with 
other processes to detect presence of visible clouds, whether or not those processes employ 
thermal imaging. 

25 By way of overview, embodiments of the present invention provide methods, 

computer-readable media, and systems for determining whether a data point indicates a 
presence of a sub-visible cloud using visible, near-infrared, and short wavelength infrared 
data. A data point is selected from an imaging study of an area potentially covered by at 
least one of visible clouds and sub-visible clouds. A determination is made of whether the 
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data point indicates presence of a sub-visible cloud. The determination is made by first 
excluding presence of visible cloud, and then comparing a cirrus-band reflectance of the data 
point with a sub-visible cirrus-band reflectance threshold. The data point is classified as a 
sub-visible cloud point if the cirrus-band reflectance of the data point exceeds the sub-visible 
5 cirrus band reflectance threshold. 

Studying images, empirically it can be determined for each of these data points 
whether the data point signifies a cloud point or a non-cloud point. It will be appreciated 
that, in accordance with embodiments of the present invention, a number of quantities can be 
calculated for each data point using data extractable from visible, near-infrared, and short- 

10 wavelength infrared data. By studying these calculated quantities, threshold values are 
determinable by which the calculated quantities suitably are used to automatically determine 
whether a data point represents a cloud point or a non-cloud point. It will also be appreciated 
that, although embodiments of the present invention may analyze data to determine a 
presence of both visible clouds and sub-visible cloud layers, a presently preferred 

15 embodiment of the present invention is tailored to classifying data points based on whether 
the data points indicate the presence of visible clouds. 

FIGURE 2 shows an exemplary graph 200 of such calculated quantities. Examining 
such a graph or other data representation in conjunction with associated cloud masks and 
RGB image, it can be determined what data points should be classified as cloud points and 

20 which should be classified as non-cloud points. More specifically, the graph shows 
normalized difference snow index, NDSI, plotted on a vertical axis 210 against values of a D 
variable on the horizontal axis 220. In one embodiment, NDSI is determined by equation 



The reflectance values, p G reen and Pswiri, represent reflectance in the selected wavelength 
range, such as the green wavelengths, the short-wave infrared wavelength, respectively. The 
D variable, in turn, is determined from a normalized difference vegetation index, NDVI, 
30 respectively determined from equations (2) and (3): 



(1): 



25 



NDSI = (p Green - p swm )/{p Green + p swm ) 



(1) 
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D = \NDVl\°- 6 /(p R J 2 (2) 
NDVI = (p NIR -p K J/(p NIR +p R J (3) 

5 

The reflectance values, pR e d and Pnir, represent reflectance in the selected wavelength range, 
such as the red wavelengths, the near-infrared wavelengths, respectively. 

The graph 200 shows values of NDSI versus D for data points that have been 
empirically identified by manual, visual inspection of an area of interest as representing 

10 bodies of water 230, shadows 240, ground 250, and clouds 260. Thus, because the data used 
in deriving NDSI, D, and NDVI is derivable from visible/near-infrared and short-wavelength 
infrared data, data points representing cloud points and non-cloud points can be identified 
without separate thermal infrared data. 

A comparable analysis is achievable using different formulations of D. For example, 

15 in analyzing data collected by the Multiangle Imaging SpectroRadiometer (MISR) sensor 
used by NASA, D is calculated by raising NDVI to different exponential values depending 
on a type of ground cover expected to be present in the surface being imaged. Although the 
MISR D use is more complex because of its landcover-type-dependent NDVI exponent and 
large, statistically derived, D-threshold database, MISR D values also can be used with 

20 embodiments of the present invention to achieve satisfactory results. 

Embodiments of the present invention can employ a number of such quantities to 
classify data points as cloud points or non-cloud points. Selection, ordering, calculation, and 
comparison of such quantities can be made in order to balance computational burdens and 
desired classification precision. For example, in two exemplary embodiments described 

25 below, a first comparison involves reflectance in the cirrus-band wavelengths, p C u with a 
threshold value which provides a ready, reliable first step in classifying data points as either 
cloud points or non-cloud points. In contrast with NDSI or D, p C i can be compared to a 
threshold value without additional computation, thus making a comparison of p a as a first 
step can reduce computational burdens. It will also be appreciated that the steps can be 

30 ordered to evaluate potentially more reliable classifiers first, or the steps can be ordered to 
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provide a logical AND or OR construct to provide for reliable classification of the data 
points. 

Depending upon the computational resources available, it will be appreciated that 
analysis of data points can occur in real-time, while analysis of classification precision vs. 
5 computing load may occur in non-real-time.. If non-real-time analyses indicate that greater 
precision can be achieved, to better meet user needs within available computing resources, by 
adjusting thresholds or adding additional cited tests to the real-time test hierarchy for specific 
background landcover types, locations, or times of year, those revisions can be made for 
future real-time processing. 

10 FIGURE 3 shows a first embodiment of a routine 300 for classifying data points as 

cloud points or non-cloud points. The routine 300 begins at a block 302, and a next point of 
top of atmosphere, visible, near-infrared, and short-wavelength infrared data is submitted for 
processing at a block 304. At a block 306, a comparison of the p C \ to a cirrus-band threshold 
cloud value is made. If p C \ exceeds the threshold value, the data point is classified as a cloud 

15 point at a block 308. If not, the routine 300 proceeds to a next block to make a further 
comparison of whether the data point represents a cloud point or a non-cloud point. 

In one particular embodiment, the p C \ comparison at the block 306 is made at a 
wavelength of 1.88 fim. At this wavelength, the reflectance has been determined to be more 
reliable than at slightly lower wavelengths. Of course, in alternate embodiments, p C i may be 

20 tested at wavelengths other than 1.88 /xm, such as at 1.38 /xm or other cirrus bands. 

If the comparison of p C \ at the block 306 to make an initial determination of whether 
the data point was a cloud point did not result in the data point being classified as a cloud 
point at the block 308, additional comparisons can be made to further differentiate whether 
the data point is a cloud point or a non-cloud point. The comparisons and number of 

25 comparisons selected suitably are chosen to balance between computational simplicity and 
classification precision. Generally, as a greater number of comparisons are performed, 
greater precision is obtained. Nonetheless, selecting a fewer number of comparisons may 
result in a desirable degree of accuracy with fewer comparisons and/or calculations being 
made. 
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More specifically, if the comparison of the data point at the block 306 does not result 
in the data point being identified as a cloud point at the block 308, at a block 310 the NDSI is 
compared to an NDSI snow threshold value. This comparison may eliminate data points 
showing snow. If the data point NDSI is greater than the NDSI snow threshold value, the 
5 data point is a snow point. Again, the NDSI threshold value may be empirically determined 
using other information from which data points have previously been classified as cloud 
points or non-cloud points. If at the block 310 the NDSI exceeds the NDSI snow threshold 
value, the data point is classified as a non-cloud point at the block 312. 

It will be appreciated how threshold values like the NDSI snow threshold value 

10 compared at the block 310 can affect classification precision. If, for example, the NDSI 
snow threshold is lowered, more data points may be classified as non-cloud ground points. If 
analysis reveals that this revision results in a net improvement in classification accuracy, 
application of further comparisons in the routine 300 may be avoided. Adjusting the 
thresholds in the tests described will determine how the individual data points in thinly cloud 

15 covered areas are classified. Accordingly, selection of thresholds based on empirical analysis 
of tested values for test data points known to be cloud points or non-cloud points over 
specific categories of landcover, location and season will incorporate a predetermined 
classification accuracy into embodiments of the present invention. 

If the comparison of the data point at the block 310 does not result in the data point 

20 being identified as a non-cloud point at the block 312, then at a block 314, a comparison of a 
ratio of the near infrared data to the short-wavelength infrared data, NIR/SWIR1, to a 
NIR/SWIR1 snow threshold value is made to potentially eliminate data points showing snow. 
If the NIR/SWIR1 value exceeds the NIR/SWIR1 snow threshold value, the data point is 
classified as a non-cloud point at the block 312. 

25 If the comparison of the data point at the block 314 does not result in the data point 

being identified as a non-cloud point at the block 312, then at a block 316 a comparison of a 
ratio of the NDSI value to an NDSI cloud threshold value is made to potentially eliminate 
data points showing bright ground. If the NDSI value is less than the NDSI cloud threshold 
value, the data point is classified as a non-cloud point at the block 312. 
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If the comparison of the data point at the block 316 does not result in the data point 
being identified as a non-cloud point at the block 312, at a block 318 a comparison of the D 
variable is made with a D variable cloud threshold to potentially eliminate data points 
showing vegetation . If the D variable is greater than the D variable cloud threshold, the data 
5 point is classified as a non-cloud point at the block 312. 

If the comparison of the data point at the block 3 1 8 does not result in the data point 
being identified as a non-cloud point at the block 312, then at a block 320 a comparison of a 
D spatial variability index, DSVI, is made with a DSVI cloud threshold to potentially 
eliminate data points showing non-smooth features. In one particular embodiment, the D 
10 spatial variability index may be given by: 

DSVI = \D m -D c \ (4) 

D m is mean of D values for at least a three-by-three matrix of data points surrounding the 
1 5 data point and D c is a central pixel in the three-by-three matrix of data points. If the DSVI is 
greater than the DSVI cloud threshold value, the data point is classified as a non-cloud point 
at the block 312. 

It will be appreciated that calculation of the DSVI is a more computationally 
intensive step than other steps previously undertaken. The DSVI is derived from a plurality 

20 of D values which, in turn, are calculated from reflectance data of the data point. It will be 
appreciated that this step is not a first step in the routine 300 allowing for the possibility of 
faster, less-intensive methods associated with the foregoing blocks allowing for the data 
point to be classified as a cloud point 308 or a non-cloud point at the block 312. On the other 
hand, should additional computing power be available, the D m portion of DSVI could be 

25 computed for a larger matrix of points such as a mean of a five-by-five or larger matrix, 
centered on D c . Use of a larger matrix can increase the accuracy of the DSVI comparison by 
providing a statistically better D m portion. If the comparison of the data point at the block 
320 does not result in the data point being identified as a non-cloud point at the block 312, 
then at a block 322 a comparison of the short-wavelength reflectance, Pswiri, is made to a 

30 short-wavelength reflectance cloud threshold to potentially eliminate data points showing 
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dark features. If Pswiri is less than the short-wavelength reflectance cloud threshold, the data 
point is classified as a non-cloud point at the block 312. 

If the comparison of the data point at the block 322 does not result in the data point 
being identified as a non-cloud point at the block 312, then at a block 324 a comparison of 
5 PRed to a red wavelength cloud threshold value is made to eliminate additional data points 
showing dark features. If p Red is less than the red wavelength cloud threshold value, the data 
point is classified as a non-cloud point at the block 312. 

If the comparison of the data point at the block 324 does not result in the data point 
being identified as a non-cloud point at the block 312, then at a block 326, a comparison of a 

10 ratio of the NIR/SWIR1 to a NIR/SWIR1 cloud threshold value is made to potentially 
eliminate additional data points showing bright ground. If the NIR/SWIR1 value is less than 
the NIR/SWER1 cloud threshold value the data point is classified as a non-cloud point at the 
block 312. On the other hand, if the NIR/SWIR1 value is greater than the NER/SWIR1 cloud 
threshold value, the data point is classified as a cloud point at the block 308. 

15 Once the data points have been classified as one of a cloud point at the block 308, or 

as a non-cloud point at the block 312, then at a block 328 it is determined if all data points of 
interest have been classified. If not, the routine 300 loops to the block 304 where the next 
data point is addressed. However, if it is determined at the block 328 that all the data points 
of interest have been analyzed, the routine 300 ends at the block 330. 

20 As previously described, the routine 300 uses cloud thresholds empirically derived 

from manual or other studies of overhead imaging data. The threshold values may vary 
depending on the nature of the area of interest and the season during which the imaging data 
is captured. For example, threshold values for forests or closed shrub areas will vary 
between summer/tropical seasons and snowy seasons, just as the threshold values will vary 

25 between permanent wetlands and permanently snow-covered areas. For example, and not by 
way of limitation, Table 1 presented below lists representative threshold values that suitably 
may be used in the routine 300 for scenes and seasons of interest: 



Scene 


Season 


D 


NDSI snow 


NDSI clMd 


DSVI 


PSWIRl 


NIR/SWIRl Jnow 


NIR/SWIRl cl0Od 


PRed 


Pdoad 


Forest/ 
Closed 
Shrub 


Summer 
or 

Tropical 


20 


N/A 


-0.25 


1 


0.1 


N/A 


1 


0.1 


0.03 
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(fit 


Spring or 
Fall 

without 
snow 


1 r\ 
1U 


XI/ A 

IN/A 


A 1C 


J. 5 


A 1 

U.l 


XI/ A 

N/A 


1 


0.1 


0.03 




Fall, 

Spring or 

Winter 

(snow) 


2 


0.55 


-0.3 


0.2 


0..2 


4 


N/A 


0.1 


0.03 


Grass or 
Crops 


Summer 


20 
(40) 


N/A 


-0.3 


1 


0.1 


N/A 


1 


0.1 


0.03 


«>> 


Spring or 

Poll \\rii\ 

ran w/o 
snow 


10 


N/A 


-0.35 


1 


0.1 


N/A 


0.9 


0.1 


0.03 




Fall, 

Spring or 

winucr 

w/snow 


2 


0.55 


-0.35 


0.2 


0.2 


4 


1 


0.2 


0.03 


Snow 
and Ice 


All 


2 


0.55 


-0.3 


0.2 


0.2 


4 


N/A 


0.1 


0.03 


Barren 
or Sparse 
Open 
Shrub 


(No 
Snow) 


4 


N/A 


-0.25 


1 


0.1 


N/A 


0.8 


0.2 


0.03 


Savanna 


(No 
Snow) 


10 


N/A 


-0.35 


1 


0.1 


N/A 


0.8 


0.2 


0.03 



Table 1 



It will be appreciated that thresholds can be derived from study of other scenes and 
terrains, such as wetlands or water-covered areas as well 
5 Various combinations of tests can be used to optimally balance desires for accuracy 

and computing efficiency. For example, accurate results are obtainable according to a subset 
of the routine 300 (FIGURE 3) where comparisons at the decision blocks 306, 316, 318, 320, 
and 326 and at least one of the comparisons at the decision blocks 310, 314, and 322. Table 
2, on a next page, shows a computed accuracy for tests and combinations of tests run on a 
1 0 number of data sets. 
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v> 



3 
8 



Table 2 
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FIGURE 4 shows a second embodiment of a routine 400 for classifying data points as 
cloud points or non-cloud points. The routine 400 begins at a block 402, and a next point of 
top of atmosphere visible, near-infrared, and short-wavelength infrared data is submitted for 
processing at a block 404. At a block 406, a comparison of the pci to a cirrus-band threshold 
cloud value is made. If p C \ exceeds the cloud threshold value, the data point is classified as a 
cloud point at a block 408. If not, the routine 400 proceeds to a next block to make a further 
comparison of whether the data point represents a cloud point or a non-cloud point. 

If the comparison of the data point at the block 406 does not result in the data point 
being identified as a cloud point at the block 408, then at a block 410 the NDSI is compared 
to an NDSI minimum threshold value and an NDSI maximum threshold value. The NDSI 
thresholds are set according to empirical analysis of NDSI data such as that shown in 
FIGURE 2. Unlike the routine shown in FIGURE 3 which uses single-value cutoff 
thresholds, at the block 410 the threshold defines an area of the graph 200 (FIGURE 2) as 
opposed to an intercept. More specifically, the comparison of NDSI at the block 410 is: 

NDSI > [(Nm-N l )/D t ]*D+N l 
AND 

NDSI < [(Nm-N h )/D t ]*D+N l 
20 

If either comparison is false, the data point is classified as a non-cloud point at a block 412. 

Values for these threshold calculation numbers are included in Table 2, below. 

If the comparison of the data point at the block 410 does not result in the data point 

being identified as a non-cloud point at the block 412, at a block 414 a comparison of a ratio 
25 of NIR/SWIR1 to a NIR/SWIR1 snow threshold value is made. If the NIR/SWIR1 value is 

greater than the NIR/SWIR1 snow threshold value, the data point is classified as a non-cloud 

point at the block 412. 

If the comparison of the data point at the block 414 does not result in the data point 

being identified as a non-cloud point at the block 412, then at a block 416 a comparison of a 
30 ratio of the NIR/SWIR1 value to an NIR/SWIR1 cloud threshold value is made. If the 
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NIR/SWIR1 value is less than the NIR/SWIR1 cloud threshold value, the data point is 
classified as a non-cloud point at the block 412. 

If the comparison of the data point at the block 416 does not result in the data point 
being identified as a non-cloud point at the block 412, then at a block 418 a comparison of 
5 PRed to a red wavelength cloud threshold value is made. If p Red is less than the red 
wavelength cloud threshold value, the data point is classified as a non-cloud point at the 
block 412. 

If the comparison of the data point at the block 418 does not result in the data point 
being identified as a non-cloud point at the block 412, then at a block 420 a comparison of 

10 the short-wavelength reflectance, Pswiri, is made to a short-wavelength reflectance cloud 
threshold. If Pswiri is less than the short-wavelength reflectance cloud threshold, the data 
point is classified as a non-cloud point at the block 412. 

If the comparison of the data point at the block 420 does not result in the data point 
being identified as a non-cloud point at the block 412, then at a block 422 a comparison of 

15 the DSVI is made with a DSVI cloud threshold. If the DSVI exceeds the DSVI cloud 
threshold, the data point is classified as a non-cloud point at the block 412. On the other 
hand, if the DSVI is less than the DSVI cloud threshold, the data point is classified as a cloud 
point at the block 408. 

Once the data points have been classified as one of a cloud point at the block 408 or 

20 as a non-cloud point at the block 412, then at a block 424 it is determined if all data points of 
interest have been classified. If not, the routine 400 loops to the block 404 where the next 
data point is addressed. However, if it is determined at the block 424 that all the data points 
of interest have been analyzed, the routine 400 ends at the block 426. 

As previously described, the routine 400 uses threshold calculations empirically 

25 derived from manual or other studies of overhead imaging data. The threshold values may 
vary depending on the nature of the area of interest and the season during which the imaging 
data is captured. For example, threshold values for forests or closed shrub areas will vary 
between summer/tropical seasons and snowy seasons, just as the threshold values will vary 
between permanent wetlands and permanently snow-covered areas. Again, for example and 
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not by way of limitation, Table 3 below lists representative threshold values that suitably 
may be used in the routine 400: 



Scene 


T(CI) cload 


N L 


N M 


N H 


D T 


T(NIR/SWIRl) snow 


IXNIR/SWIRl)^,, 


PRed 


SWIR1 


DSVI 


Forest - 
summer 
mid- 
latitude 


0.03 


-0.2 


-0.15 


1 


20 


N/A 


0.8 


0.1 


0.1 


1 


Forest - 
tropical 


0.03 


-0.5 


-0.3 


1 


20 


N/A 


0.8 


0.1 


0.1 


1 


Crops or 
Mosaic - 
Summer 


0.03 


-0.3 


-0.2 


1 


40 


N/A 


0.8 


0.1 


0.1 




Grass - 
Summer 


0.03 


-0.3 


-0.2 


1 


20 


N/A 


0.8 


0.1 


.0.1 




Crops or 
Mosaic - 
Spring 


0.03 


-0.3 


-0.2 


1 


10 


N/A 


0.8 


0.1 


0.1 




Crops or 
Mosaic - 
Snow 


0.03 


-0.5 


-0.3 


0.6 


5 


4 


0.8 


0.1 


0.1 




Barren 


0.03 


-0.3 


-0.2 


1 


3 


N/A 


0.8 


0.1 


0.1 




Savanna 
or Open 
Shrub 


0.03 


-0.3 


-0.2 


1 


10 


N/A 


0.8 


0.1 


0.1 





5 Table 3 



It will be appreciated that the routine 400 (FIGURE 4) simplifies the selection of threshold 
values. 

FIGURE 5 shows a system 500 according to an embodiment of the present invention. 

10 Imaging data 510, including imaging data from at least one data point, is received. Threshold 
data 520, such as the parameters previously described in connection with FIGURES 3 and 4 
and Tables 1 and 2, is supplied to the system for comparison. A cirrus band comparator 530 
makes a first comparison of the data point with a cirrus band threshold. As previously 
described, if the cirrus band reflectance of the data point exceeds the cirrus band threshold, 

15 the data point is classified as a cloud point in cloud mask data 550 and/or a cloud mask 560. 
On the other hand, if use of the cirrus band comparator 530 does not result in classification of 
the data point, a secondary comparator 540 is applied to classify the data point. Using 
routines previously described in connection with FIGURES 3 and 4, the secondary 
comparator 540 uses additional cloud indicators and cloud indicator thresholds to classify the 

20 data points. When the secondary comparator 540 classifies the data point as either a cloud 
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point or a non-cloud point, the data point is appropriately classified in the cloud mask data 
550 and/or the cloud mask 560 in accordance with the predetermined classification precision 
determined by the threshold levels established for the comparisons being made. The system 
500 suitably is applied to all data points in the imaging data 510 to generate cloud mask data 
5 550 and/or a cloud mask 560 for the imaging data 510. 

It will be appreciated that, in one embodiment of the invention, the determination as 
to acceptability of accuracy provided by a given set of tests and thresholds would be 
determined by processing a representative set of imagery off-line, and by evaluating resultant 
cloud masks in comparison with "truth" cloud masks produced by expert analysis. 
10 Adjustments would be iterated and evaluated for optimization, and production test hierarchy 
and thresholds would then be adjusted for subsequent on-line production runs. 

As will be described below, embodiments of the present invention can be combined 
with embodiments of the invention previously submitted for detection of visible clouds. As 
previously described, presence of visible clouds can de discerned using visible, near-infrared, 
15 and short wavelength infrared data. An aspect of embodiments of the previously-described 
invention involved comparing measured reflectance in a cirrus band with thresholds 
indicating presence or absence of visible clouds. Embodiments of the invention use cirrus 
band reflectance to discern presence or absence of sub-visible cirrus clouds as well. 

FIGURE 6 shows a routine 600 according to an embodiment of the present invention 
20 for detecting presence of sub-visible clouds as well as detecting presence of visible clouds. 
In the routine 600, it is first determined if the data point indicates the presence of a visible 
cloud, then it is determined if the data point indicates the presence of a sub-visible cloud. 

The routine 600 begins at a block 602. At a block 604, a next point of top of 
atmosphere data is selected and input for processing. At a decision block 606, it is 
25 determined whether the data point indicates the presence of a visible cloud point. Whether 
the data point indicates the presence of a visible cloud, as previously described, may be 
determined using thermal imaging, or using another process. If at the decision block 606 it is 
determined that the data point indicates the presence of a visible cloud, at a block 608 the 
data point is classified as a visible cloud point. If at the decision block 606 it is determined 
30 that the data point does not indicate the presence of a visible cloud, then at a decision block 
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610 it is determined if the cirrus band reflectance of the data point exceeds the cirrus band 
reflectance threshold for a sub-visible cloud in accordance with the following Equation (5): 



P a >Tl(CI) svcloud (5) 

5 

In one embodiment, the cirrus band approximately includes 1.88 fim wavelength and/or 1.38 
fim wavelength cirrus bands. However, other cirrus bands that are similarly located within 
atmospheric water vapor absorption features suitably may be used with embodiments of the 
present invention. 

10 In one particular embodiment, the sub-visible cirrus band reflectance threshold for 

detection of sub- visible cirrus clouds Tl(CI) includes approximately a top-of-atmosphere 
reflectance of 0.01 . The Tl(CI) threshold selected may be a function of the sensor capability 
to reject effects of "out-of-band" radiation in its cirrus band, a function of sensor signal to 
noise ratio, and/or a function of the intended image processing end product error budget 

15 allocated to undetected thin cirrus clouds. The useful Tl(CI) detection threshold for a given 
scene segment will also be a function of the influence of atmospheric water vapor and/or 
underlying Earth surface reflectance in preventing or enabling Earth-surface-reflected 
radiation to penetrate the atmosphere, reach the sensor, and act as contamination in the cirrus 
band. 

20 If, at the decision block 610 it is determined that the cirrus band reflectance p C i of the 

data point exceeds the sub- visible cloud cirrus-band reflectance threshold Tl(CI), then at a 
block 612 the data point is classified as representing a sub-visible cloud point. On the other 
hand, if at the decision block 610 it is determined that the cirrus-band reflectance of the data 
point does not exceed the cirrus-band reflectance threshold Tl(CI), having already 

25 established at the decision block 606 that the data point does not indicate presence of a 
visible cloud, at a block 614 the data point is classified as a ground point. 

At a decision block 616 it is determined whether all the data points for which analysis 
is desired have been tested according to the routine 600. If not all the desired data points 
have been tested, the routine 600 loops to the block 604 to receive and evaluate the next data 
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point. On the other hand, if it is determined at the decision block 616 that all the desired data 
points have been evaluated, the routine ends at the block 618. 

FIGURE 7 shows a routine 700 to determine the presence of both visible and sub- 
visible clouds using visible, near-infrared, and short-wavelength infrared data. In previously 
5 described routines 300 (FIGURE 3) and 400 (FIGURE 4), the threshold values were 
established for detection of visible clouds. As a result, the cloud threshold values have been 
re-labeled herein as visible cloud threshold values to clarify which tests are directed to 
detecting visible clouds distinct from tests used to discern the presence of sub-visible clouds 
in accordance with embodiments of the present invention. 

10 The routine 700 begins at a block 702, and a next point of top of atmosphere, visible, 

near-infrared, and short-wavelength infrared data is submitted for processing at a block 704. 
At a block 706, a comparison of the p a to a cirrus-band threshold visible cloud threshold 
value Tl(CI) vc ioud is made. If p C i exceeds the visible cloud threshold value, the data point is 
classified as a visible cloud point at a block 708. If not, the routine 700 proceeds to a 

15 decision block 710 to make a further comparison of whether the data point represents a 
visible cloud point. 

In one particular embodiment, the p a comparison at the block 706 is made at a 
wavelength of 1.88 /xm. At this wavelength, the reflectance has been determined to be more 
reliable than at slightly lower wavelengths. Of course, in alternate embodiments, p C \ may be 

20 tested at wavelengths other than 1.88 Jim, such as at 1.38 /mi or other cirrus bands. 

If the comparison of p C \ at the block 706 to make an initial determination of whether 
the data point is a visible cloud point did not result in the data point being classified as a 
visible cloud point at the block 708, additional comparisons can be made to further 
differentiate whether the data point is a cloud point or a non-cloud point. The comparisons 

25 and number of comparisons selected suitably are chosen to balance between computational 
simplicity and classification precision. Generally, as a greater number of comparisons are 
performed, greater precision may be obtained in determining presence of visible cloud points. 
Nonetheless, selecting a fewer number of comparisons may result in a desirable degree of 
accuracy with fewer comparisons and/or calculations being made. 
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More specifically, if the comparison of the data point at the block 706 results in the 
data point not being identified as a visible cloud point at the block 708, at a decision block 
710 the NDSI is compared to an NDSI snow threshold value. This comparison may 
eliminate data points showing snow. If the data point NDSI is greater than the NDSI snow 
5 threshold value, the data point may reflect a snow point. Again, the NDSI threshold value 
may be empirically determined using other information from which data points have 
previously been classified as cloud points or non-cloud points. If at the decision block 710 
the NDSI exceeds the NDSI snow threshold value, the data point is identified as not being a 
visible cloud point, and then the data point is evaluated at a decision block 712 to determine 
10 whether the data point indicates presence of a sub-visible cloud as will be described further 
below. 

It will be appreciated how threshold values like the NDSI snow threshold value 
compared at the decision block 710 can affect classification precision. If, for example, the 
NDSI snow threshold is lowered, more data points may be classified as not being visible- 

15 cloud points. If analysis reveals that this revision results in a net improvement in 
classification accuracy, application of further comparisons in the routine 700 may be 
avoided. Adjusting the thresholds in the tests described will determine how the individual 
data points in thinly cloud covered areas are classified. Accordingly, selection of thresholds 
based on empirical analysis of tested values for test data points known to be cloud points or 

20 non-cloud points over specific categories of land cover, location and season will incorporate 
a predetermined classification accuracy into embodiments of the present invention. 

If the comparison of the data point at the decision block 710 results in the data point 
not being identified as a snow point, then at a decision block 718, a comparison of a ratio of 
the near infrared data to the short-wavelength infrared data, NIR/SWIR1, to a NIR/SWIR1 

25 snow threshold value is made to potentially eliminate additional data points showing snow. 
If the NIR/SWIR1 value exceeds the NIR/SWIR1 snow threshold value, the data point is 
identified as not being a visible-cloud point and the routine 700 proceeds to the decision 
block 712. 

If the comparison of the data point at the decision block 718 results in the data point 
30 not being identified as a snow point, then at a decision block 720 a comparison of the NDSI 
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value to an NDSI cloud threshold value is made to potentially eliminate data points showing 
bright ground. If the NDSI value is less than the NDSI cloud threshold value, the data point 
is identified as not being a visible-cloud point and the routine 700 proceeds to the decision 
block 712. 

5 If the comparison of the data point at the decision block 720 results in the data point 

not being identified as a bright ground point, then at a decision block 722 a comparison of the 
D variable is made with a D variable visible cloud threshold to potentially eliminate data 
points showing vegetation. If the D variable is greater than the D variable visible cloud 
threshold, the data point is identified as not being a visible-cloud point and the routine 700 

10 proceeds to the decision block 712. 

If the comparison of the data point at the decision block 722 results in the data point 
not being identified as a vegetation point, then at a decision block 724 a comparison of a D 
spatial variability index, DSVI, is made with a DS VI visible cloud threshold to potentially 
eliminate data points showing non-smooth features as previously described. If the DSVI is 

15 greater than the DSVI visible cloud threshold value, the data point is identified as not being a 
visible-cloud point and the routine 700 proceeds to the decision block 712. 

If the comparison of the data point at the block 724 results in the data point not being 
identified as a non-smooth feature, then at a decision block 726 a comparison of the short- 
wavelength reflectance, Pswiri, is made to a short-wavelength reflectance visible cloud 

20 threshold to potentially eliminate data points showing dark features. If Pswiri is less than the 
short-wavelength reflectance visible cloud threshold, the data point is identified as not being 
a visible cloud point and the routine 700 proceeds to the decision block 712. 

If the comparison of the data point at the block 726 results in the data point not being 
identified as a dark feature, then at a decision block 728 a comparison of p Re d to a red 

25 wavelength visible cloud threshold value is made to eliminate additional data points showing 
dark features. If p Re d is less than the red wavelength visible cloud threshold value, the data 
point is identified as not being a visible cloud point and the routine 700 proceeds to the 
decision block 712. 

If the comparison of the data point at the block 728 results in the data point not being 

30 identified as a dark feature, then at a decision block 730 a comparison of a ratio of the 
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NIR/SWIR1 to a NIR/SWIR1 visible cloud threshold value is made potentially to eliminate 
additional data points showing bright ground. If the NIR/SWIR1 value is less than the 
NIR/SWIR1 visible cloud threshold value the data point is identified as not being a visible 
cloud point and the routine 700 proceeds to the decision block 712. On the other hand, if the 
5 NIR/SWIR1 value is greater than the NIR/SWIR1 visible cloud threshold value, the data 
point is classified as a visible cloud point at the block 708. 

For data points not classified as being a visible cloud point at the block 708, at the 
decision block 712 it is determined if the cirrus band reflectance of the data point is greater 
than the cirrus band sub-visible cloud threshold. If the cirrus band reflectance of the data 
10 point is determined to exceed the sub-visible cloud threshold, at the block 732 the data point 
is classified as a sub-visible cloud point. On the other hand, if it is determined at the decision 
block 712 that the cirrus-band reflectance of the data point does not exceed the sub-visible 
cloud threshold, at a block 734 the data point is identified as a ground point. 

Once the data points have been classified as one of a cloud point at the block 708, a 
15 sub- visible cloud point at the block 732, or as a ground point at the block 734, at a decision 
block 736 it is determined if all data points of interest have been classified. If not, the 
routine 700 loops to the block 704 where the next data point is received for evaluation. 
However, if it is determined at the block 736 that all the data points of interest have been 
analyzed, the routine 700 ends at the block 740. 
20 As previously described, the routine 700 uses visible cloud and sub-visible cloud 

thresholds empirically derived from manual or other studies of overhead imaging data. The 
threshold values may vary depending on the nature of the area of interest and the season 
during which the imaging data is captured. For example, threshold values for forests or 
closed shrub areas will vary between summer/tropical seasons and winter seasons, just as the 
25 threshold values will vary between permanent wetlands and arid areas, etc. 

FIGURE 8 shows another embodiment of a routine 800 to determine the presence of 
both visible and sub-visible clouds using visible, near-infrared, and short-wavelength infrared 
data. The routine 800 advantageously supports correction for thin cirrus effects in regions 
where there are no underlying low clouds. Generally, the routine 800 employs the same 
30 comparisons, but the comparisons are ordered differently. Note that in routines 300 
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(FIGURE 3) and 700 (FIGURE 7) the cirrus band visible cloud test at blocks 306 and 706 are 
applied before other visible cloud tests, and if visible cloud is detected with the cirrus band 
test the other visible cloud tests are not applied. Applying the cirrus band visible cloud test 
first is computing-resource efficient. However, applying the cirrus band visible cloud test 
5 first does not allow separation of data points with visible middle and low- and middle- 
altitude clouds from those with thin but visible high cloud that are detectable only with the 
cirrus band. This is true, for example, in the case where there are no detectable lower clouds. 
Both thin but visible high cirrus clouds and sub-visible high cirrus clouds are potentially 
correctible in order to enhance utility of spectral imagery for later applications. However, 

10 cirrus-corrected data points generally have utility for land-surface applications only in the 
case where middle and/or low altitude clouds are not present to obscure the land surface 
beneath the high cirrus clouds. Additionally, cirrus corrections are possible with useful 
accuracy only to some arbitrary cirrus reflectance threshold above that of visibility, such as 
where the reflectance is approximately 0.03), which it is assumed coincides with the 

15 threshold at which thin but visible cirrus clouds are detectible with the non-cirrus-band tests. 

In routine 800, the computing resources to apply the set of non-cirrus-band visible 
cloud tests 810, 818,820, 822, 824, 826, 828 and 830 are committed first at each data point in 
order to capture all visible low- and middle-altitude cloud points and relatively thick high 
cloud points that satisfy those tests into block 808a. The cirrus band visible cloud test at the 

20 block 806 is then applied to those data points failing the non-cirrus-band sequence of visible 
cloud tests. Visible cloud points meeting only the cirrus band test are collected at the block 
808b. Subsequently, data points failing both types of visible cloud tests are subjected to the 
sub-visible cirrus cloud test at the block 812, and sub-visible cloud points are collected at the 
block 832. 

25 Other applications are therefore made possible. Visible cloud masks, as discussed for 

routines 300 and 700, may still be produced from the data points collected at the blocks 808a 
and 808b. In addition, cirrus cloud corrections may be applied to the sub-visible cirrus cloud 
points collected into block 832 and to the thin but visible cirrus cloud points collected at the 
block 808b. 
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We do not here provide a detailed method for making the corrections to visible, near 
infrared, and short-wave infrared imagery for presence of thin visible and subvisible clouds. 
Embodiments of the present invention provide an overall cloud detection approach for 
implementation in an automated imagery processing framework with intent to facilitate 
5 automated application and interpretation of those corrections. A thin cirrus correction 
approach would take advantage of the relatively flat spectral dependence of cirrus cloud 
reflectance across the visible, near infrared, and short-wave infrared spectral range of the 
processed imagery, except for the effects of ice and water vapor absorption experienced by 
the cirrus-reflected radiance measured in the cirrus band. Corrections for upwelling cirrus- 

10 cloud-reflected radiance "contamination" would be computed based upon measured 
reflectance in the cirrus band near each data point, adjusted for the above-mentioned ice and 
water vapor absorption in the cirrus band, and then subtracted from other spectral band 
reflectance values at each data point. A compatible approach to making these cirrus 
corrections using 1.38 micron cirrus band measurements, that would be equally applicable at 

15 1.88 micron cirrus band measurements is described in other publications. For example, such 
an approach is explained in "Correction of thin cirrus path radiances in the 0.4 - 1.0 micron 
spectral region using the sensitive 1.375 micron cirrus detecting channel," B.-C. Gao, YJ. 
Kaufman, W. Han. and W.J. Wiscombe, Journal of Geophysical Research, Vol. 103, No. 
D24, pp. 32,169-32,176, December 27, 1998, and "An algorithm using visible and 1.38 

20 micron channels to retrieve cirrus cloud reflectances from aircraft and satellite data," B.-C. 
Gao, P. Yang, W. Han, R.-R. Li, and WJ. Wiscombe, IEEE Transactions on Geoscience and 
Remote Sensing, Vol. 40, No. 8, August 2002. Other approaches to detailed correction for 
thin cirrus cloud effects in visible, near infrared, and short-wave infrared imagery may also 
be facilitated by approaches to cloud detection in automated imagery processing previously 

25 described. 

The routine 800 begins at a block 802, and a next point of top of atmosphere, visible, 
near-infrared, and short-wavelength infrared data is submitted for processing at a block 804. 
At a decision block 810 the NDSI is compared to an NDSI snow threshold value. This 
comparison may eliminate data points showing snow. If the data point NDSI is greater than 
30 the NDSI snow threshold value, the data point may reflect a snow point. Again, the NDSI 
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threshold value may be empirically determined using other information from which data 
points have previously been classified as cloud points or non-cloud points. If at the decision 
block 810 the NDSI exceeds the NDSI snow threshold value, the data point is identified as 
not being a visible cloud point, and then the data point is evaluated at a decision block 812 to 
5 determine whether the data point indicates presence of a sub-visible cloud as will be 
described further below. 

It will be appreciated how threshold values like the NDSI snow threshold value 
compared at the decision block 810 can affect classification precision. If, for example, the 
NDSI snow threshold is lowered, more data points may be classified as not being visible- 

10 cloud points. If analysis reveals that this revision results in a net improvement in 
classification accuracy, application of further comparisons in the routine 800 may be 
avoided. Adjusting the thresholds in the tests described will determine how the individual 
data points in thinly cloud covered areas are classified. Accordingly, selection of thresholds 
based on empirical analysis of tested values for test data points known to be cloud points or 

15 non-cloud points over specific categories of land cover, location and season will incorporate 
a predetermined classification accuracy into embodiments of the present invention. 

If the comparison of the data point at the decision block 810 results in the data point 
not being identified as a snow point, then at a decision block 818, a comparison of a ratio of 
the near infrared data to the short-wavelength infrared data, NIR/SWIR1, to a NIR/SWIR1 

20 snow threshold value is made to potentially eliminate additional data points showing snow. 
If the NIR/SWIR1 value exceeds the NIR/SWIR1 snow threshold value, the data point is 
identified as not being a visible-cloud point and the routine 800 proceeds to the decision 
block 812. 

If the comparison of the data point at the decision block 818 results in the data point 
25 not being identified as a snow point, then at a decision block 820 a comparison of the NDSI 
value to an NDSI cloud threshold value is made to potentially eliminate data points showing 
bright ground. If the NDSI value is less than the NDSI cloud threshold value, the data point 
is identified as not being a visible-cloud point and the routine 800 proceeds to the decision 
block 812. 
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If the comparison of the data point at the decision block 820 results in the data point 
not being identified as a bright ground point, then at a decision block 822 a comparison of the 
D variable is made with a D variable visible cloud threshold to potentially eliminate data 
points showing vegetation. If the D variable is greater than the D variable visible cloud 
5 threshold, the data point is identified as not being a visible-cloud point and the routine 800 
proceeds to the decision block 812. 

If the comparison of the data point at the decision block 822 results in the data point 
not being identified as a vegetation point, then at a decision block 824 a comparison of a D 
spatial variability index, DSVI, is made with a DSVI visible cloud threshold to potentially 
10 eliminate data points showing non-smooth features as previously described. If the DSVI is 
greater than the DSVI visible cloud threshold value, the data point is identified as not being a 
visible-cloud point and the routine 800 proceeds to the decision block 812. 

If the comparison of the data point at the block 824 results in the data point not being 
identified as a non-smooth feature, then at a decision block 826 a comparison of the short- 
1 5 wavelength reflectance, Pswiri , is made to a short-wavelength reflectance visible cloud 

threshold to potentially eliminate data points showing dark features. If Pswiri is less than the 
short-wavelength reflectance visible cloud threshold, the data point is identified as not being 
a visible cloud point and the routine 800 proceeds to the decision block 812. 

If the comparison of the data point at the block 826 results in the data point not being 
20 identified as a dark feature, then at a decision block 828 a comparison of p Re d to a red 
wavelength visible cloud threshold value is made to eliminate additional data points showing 
dark features. If p Re d is less than the red wavelength visible cloud threshold value, the data 
point is identified as not being a visible cloud point and the routine 800 proceeds to the 
decision block 812. 

25 If the comparison of the data point at the block 828 results in the data point not being 

identified as a dark feature, then at a decision block 830 a comparison of a ratio of the 
NIR/SWIR1 to a NIR/SWIR1 visible cloud threshold value is made potentially to eliminate 
additional data points showing bright ground. If the NIR/SWIR1 value is less than the 
MR/SWER1 visible cloud threshold value the data point is identified as not being a visible 
30 cloud point and the routine 800 proceeds to the decision block 806. On the other hand, if the 
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NIR/SWIR1 value is greater than the NIR/SWIR1 visible cloud threshold value, the data 
point is classified as a visible cloud point at the block 808a. 

At a decision block 806, a comparison of the pci to a cirrus-band threshold visible 
cloud threshold value Tl(CI) vc ioud is made. If Pci exceeds the visible cloud threshold value at 
5 the block 806, the data point is classified as a visible cloud point at a block 808b. 

For data points not classified as being a visible cloud point at the block 808b, at the 
decision block 812 it is determined if the cirrus band reflectance of the data point is greater 
than the cirrus band sub-visible cloud threshold. If the cirrus band reflectance of the data 
point is determined to exceed the sub-visible cloud threshold, at the block 832 the data point 
10 is classified as a sub-visible cloud point. On the other hand, if it is determined at the decision 
block 812 that the cirrus-band reflectance of the data point does not exceed the sub-visible 
cloud threshold, at a block 834 the data point is identified as a ground point. 

In one particular embodiment, as previously described, the p C \ comparisons at blocks 
806 and 812 are made at a wavelength of 1.88 fim. At this wavelength, the reflectance has 
15 been determined to be more reliable than at slightly lower wavelengths. Of course, in 
alternate embodiments, p C \ may be tested at wavelengths other than 1.88 /xm, such as at 1.38 
jttm or other cirrus bands. 

Once the data points have been classified as one of a cloud point at the block 808a or 
808b, a sub-visible cloud point at the block 832, or as a ground point at the block 834, at a 
20 decision block 836 it is determined if all data points of interest have been classified. If not, 
the routine 800 loops to the block 804 where the next data point is received for evaluation. 
However, if it is determined at the block 836 that all the data points of interest have been 
analyzed, the routine 800 ends at the block 840. 

As previously described, the routine 800 uses visible cloud and sub-visible cloud 
25 thresholds empirically derived from manual or other studies of overhead imaging data. The 
threshold values may vary depending on the nature of the area of interest and the season 
during which the imaging data is captured. For example, threshold values for forests or 
closed shrub areas will vary between summer/tropical seasons and winter seasons, just as the 
threshold values will vary between permanent wetlands and arid areas, etc. 

' 27 " Black Lowe & Graham — 

^ 



25315 BING.1-1053 R - h Avenue 4goo 

Seattle, Washington 98104 

PATENT TRADEMARK OFF!CE 206381 .3300 • F: 206.38! .3301 



FIGURE 9 shows a system 900 according to an embodiment of the present invention. 
Imaging data 910, including imaging data from at least one data point, is received. A set of 
threshold data 920, such as the parameters previously described in connection with 
FIGURES 6, 7, and 8 supplied to the system for comparison. A cirrus band comparator 930 
5 compares the cirrus-band reflectance value for each data point being evaluated with a cirrus 
band sub-visible cloud threshold to detect sub-visible clouds. A visible cloud detector 940, 
using thermal imaging, using visible, near visible infrared, and short-wavelength infrared 
data, or using another process to determine the presence of visible clouds is used to 
determine the presence of visible clouds as desired. If the cirrus band reflectance of the data 
10 point exceeds the sub-visible cirrus-band threshold, the data point is classified as a sub- 
visible cloud point in cloud mask data 950 and/or a cloud mask 960. If the data point is 
identified as representing presence of a visible cloud, the data point is classified as a visible 
cloud point in the cloud mask data 950 and/or the cloud mask 960. The system 900 suitably 
is applied to all data points in the imaging data 910 to generate cloud mask data 950 and/or a 
1 5 cloud mask 960 for the imaging data 910. 

It will be appreciated that, in one embodiment of the invention, the determination as 
to acceptability of accuracy provided by a given set of tests and thresholds would be 
determined by processing a representative set of imagery off-line, and by evaluating resultant 
cloud masks in comparison with "truth" cloud masks produced by expert analysis. 
20 Adjustments would be iterated and evaluated for optimization, and production test hierarchy 
and thresholds would then be adjusted for subsequent on-line production runs. 

It should be understood that the system 900 shown in FIGURE 9 may have a variety 
of alternate embodiments, and that the invention is not limited to the particular system 
embodiment shown in FIGURE 9. For example, one or more of the various components of 
25 the system 900 may be combined with other components, or may be divided into separate 
components, to produce alternate embodiments of systems in accordance with the present 
invention. Alternately, in a representative embodiment, the system 900 includes a computer 
having a central processing unit (CPU) and a memory component. The memory component 
may include one or more memory modules, such as Random Access Memory (RAM) 
30 modules, Read Only Memory (ROM) modules, Dynamic Random Access Memory (DRAM) 
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modules, and any other suitable memory modules. The computer may also include an 
input/output (I/O) component that may include a variety of known I/O devices, including 
network connections, video and graphics cards, disk drives or other computer-readable media 
drives, displays, or any other suitable I/O modules. In one particular aspect, a machine- 
readable medium may be used to store a set of machine-readable instructions (e.g. a 
computer program) into the computer, wherein the machine - readable instructions embody a 
method in accordance with the teachings of the present invention. The machine-readable 
medium may be any type of medium that can store data that is readable by the computer, 
including, for example, a floppy disk, CD ROM, optical storage disk, magnetic tape, flash 
memory card, digital video disk, RAM, ROM, or any other suitable storage medium. The 
machine-readable medium, or the instructions stored thereon, may be temporarily or 
permanently installed in any desired component of the system 900. Alternately, the machine- 
readable instructions may be implemented directly into one or more components of the 
system 900 without the assistance of the machine-readable medium. 

While preferred and alternate embodiments of the invention have been illustrated and 
described, as noted above, many changes can be made without departing from the spirit and 
scope of the invention. Accordingly, the scope of the invention is not limited by the 
disclosure of the preferred embodiment. Instead, the invention should be determined entirely 
by reference to the claims that follow. 
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